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(57) ABSTRACT 

The present' invention relates to an electronic watermark 
burying device that docs not bury the same electronic 
watermark data in a superimposing mode. An electronic 
watermark insertion device comprises discrete cosine trans- 
forming means for subjecting an input image into a discrete 
cosine transformation; electronic watermark burying means 
for inserting electronic watermark data to data transformed 
by the discrete cosine transforming means; electronic water- 
mark detecting means for detecting whether or not the 
electronic watermark data to be inserted by the electronic 
watermark burying means has been already inserted into the 
input image; and selecting means for selecting the output 
data from the discrete cosine transforming means when the 
electronic watermark detecting means detects that the elec- 
tronic watermark data has been already inserted into the 
input image or for selecting output data from the electronic 
watermark burying means when the electronic watermark 
detecting means does not detect that the electronic water- 
mark data has been not inserted into the input image; and 
means for subjecting data selected by the selecting means 
into an inverse discrete cosine transformation. 

16 Claims, 4 Drawing Sheets 
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ELECTRONIC WATERMARK INSERTION 
DEVICE 

BACKGROUND OF THE INVENTION 

The present invention relates to an electronic watermark 
insertion device suitable for digital images, and particularly 
to an electronic watermark insertion device for inserting 
electronic, watermark into digital images. 

Recently, illegal copies of digital images have become an 
important problem. Unlike analog images, since digital 
images are recognized by Os and Is, they can be repeatedly 
replicated without any degradation in image quality. This 
inherent feature has caused great damage to digital image 
copyright holders. 

In order to prevent such illegal replication, it is considered 
to prepare a reproduction system that encrypts digital image 
data and has a valid secret decryption key whereby 
encrypted digital image data can be reproduced. However, 
after the encryption is once decoded, this system cannot 
prevent subsequent replication. 

In order to prevent digital images from being illegally 
used or replicated, the method has been considered of 
burying special information (hereinafter referred to as "elec- 
tronic watermark data") in a digital image itself. 

Two types of data including visible electronic watermark 
data and invisible electronic watermark data are considered 
as electronic watermark data for digital images. 

The visible electronic watermark data, which contains 
special characters or symbols combined with an image, can 
be visually sensed. This electronic watermark data may 
degrade the image quality but has the advantage of visually 
warning users to prevent misappropriation of digital images. 

An example of burying such visible electronic watermark 
data is disclosed in JP-A-241403/1996. This patent publi- 
cation discloses a method of placing a visible watermark on 
a digital image. This method consists of the steps of sup- 
plying an original digital image, supplying a digital water- 
mark image, and superimposing the watermark on the origi- 
nal image, without changing the chromaticity of pixels of the 
original image upon watermarking, to create a watermarked 
image. This method is characterized in that the image- 
creating step includes the step of varying the brightness (not 
color) of respective opaque pixels in a watermarked image 
to correct pixels corresponding to the original image. In this 
method, only the brightness of pixels corresponding to 
opaque portions of electronic watermark data is varied so 
that visible electronic watermark data is synthesized with the 
original image without changing the color components. The 
scaling value of varying the pixel brightness component 
depends on color components, random numbers, pixel val- 
ues of electronic watermark data, or others. The prominence 
of the watermark is determined by the scaling value. 

In invisible electronic watermark data, electronic water- 
mark data is buried in an image, in consideration of degra- 
dation of image quality. Since the image quality degradation 
is not substantially negligible, the watermark cannot be 
visually recognized. 

As described above, since special information, which can 
be recognized by an author, is buried as the electronic 
watermark data, the author can be specified by detecting the 
electronic watermark data even after illegal replication. 
Moreover, information about replication disapproval may be 
buried in an image. In such a case, when the reproduction 
unit, for example, detects the replication disapproval 
information, the reproduction by a VTR or the equivalent 
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can be restricted by informing the user that the detected 
information is reproduction prohibited data, or by operating 
the replication preventing mechanism within the reproduc- 
tion unit. 

5 As one method of burying invisible electronic watermark 
data into digital images, special information is buried as 
electronic watermark data in portions not substantially 
affecting the image quality, such as LSBs (least significant 
bits) of pixel data. However, according to this method, the 

to electronic watermark data can be easily removed from 
images. For example, information regarding LSBs of pixels 
will be missed using a low-pass filter. The image compres- 
sion process discards the volume of information not 
adversely affecting the image quality, thus reducing the 

is volume of data. This means that the electronic watermark 
data is lost. As a result, the problem is that it is difficult to 
re-detect the electronic watermark data, 

JP-A-No. 315131/1994 shows another example of the 
electronic watermark burying method. This publication dis- 

20 closes the method of burying specific information by using 
the correlation between continuous frame images and detect- 
ing the area where degradation in image quality does not 
occur even when substitution is performed in peripheral 
areas upon reproduction. According to this method, an 

25 image is reconstituted by specifying an identification data 
buried area using the signal dropout portion and conversion 
information upon reproduction and then by correcting the 
corresponding portion. 

As further another example, JP-A-No. 30466/1993 dis- 

30 closes the method of converting the frequency of a video 
signal and then burying information with signals of frequen- 
cies lower than the frequency band of the converted video 
signal. In this method, a broad band-pass filter extracts the 
original video signal while a low-pass filter extracts the 

35 buried identification data. 

In another example, the method of frequency-converting 
images and then burying electronic watermark data into 
portions with strong frequency components of a video signal 

40 after the frequency conversion (see "NIKKEI Electronics", 
1996, 4.22 (no. 660), page 13). In this method, since 
electronic watermark data is buried into frequency 
components, the electronic watermark data is not lost 
through the compression process or filtering image process. 

45 Moreover, using the random numbers with a normal distri- 
bution as electronic watermark data makes it difficult to 
prevent interference between electronic watermark data and 
to destroy the electronic watermark data without signifi- 
cantly affecting the entire image. 

50 In the electronic watermark data burying method, the 
original image is first transformed into frequency compo- 
nents by the DCT (discrete cosine transformation) 703. n 
pieces of data with high values over high frequency range 
are selected as f(l), f(2), . . . , f(n). The electronic watermark 

ss data, w(l), w(2), . . . w(n), are selected from a normal 
distribution having an average of 0 and a dispersion of 1. 
The formula, F(i)=f(i)+ctx|f(i)|xw(i), where a is a scaling 
factor, is calculated to obtain respective (i)s. Finally, the 
image in which the electronic watermark data is buried is 

60 obtained based on the frequency component in which f(i) is 
substituted for F(i), 

Moreover, the electronic watermark data is detected 
according to the following method. In this detection method, 
both the original image and electronic watermark data 

65 candidate w(i) (where i«l, 2, . . . , n) must be known. 

First, the image containing electronic watermark data is 
converted into frequency components through, for example, 
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DCT. Values corresponding to factor values, f(l), f(2), . . . , wD=the absolute value of a vector w; and the symbol • 

f(n), each containing an electronic watermark, are set as represents an inner product. When the statistical similarity C 

F(l), F(2), . . . , F(n), respectively. The formula, W(i)-{F is more than a specific value, it is judged that the corre- 

(i)-f(i))/f(i), is solved using f(i) and F(i) to extract the sponding electronic watermark data is in a buried state, 

electronic watermark data W(i). Next, the statistical simi- 5 FIG. 3 shows a P rior art electronic watermark inserting 

larity C between w(i) and W(i) is obtained by the following device employing the above-mentioned method. Referring 

formula including a vector inner product. to FIG. 3, the input image 310 is transformed from the time 

region to the frequency region by means of the discrete 

c-W'w/{WDxwD) cosine transformation unit 320. The electronic watermark 

where W«(W(1), W(2), . . . , W(n); w-(w(l), w(2), . . . , 3Q burying unit 320 inserts the electronic watermark data 340 

w(n)); WD-the absolute value of a vector W; wD-the in the resultant data. The buried electronic watermark data is 

absolute value of a vector w; and the symbol • represents an transformed from the frequency region to the time region by 

inner product means of the inverse discrete cosine transformation unit 350. 

When the statistical similarity C is more than a specific Thus, the output image 360 with the inserted electronic 

value, it is judged that the electronic watermark data is in a , , watermark data can be obtained. 

* 7 * J 5 15 However, the prior-art device may insert evenly and 

U ?ne Tbove-mentioned method, where the electronic eleclronic watermark data even ™ an im *& wilh 

watermark data is buried into an image, is effective when an e ^ am 4 schernatically shows the concept of burying e lec- 

author holding an original image detects digital image data tronic watermark data m a frequency region. The frequency 

suspected as an illegal replicate. 2Q speclrum 440 after the electronic watermark data burying 

In the above-mentioned method that requires an original operat ion is formed by adding the frequency spectrum 420 

image, the author, that is, an original image owner, can . of electronic wate rmark data to the frequency region of an 

detect image data doubted as an illegal replicate. However, . { image A^^ng a specific region of an input image 

the reproduction unit in each terminal cannot detect elec- doeR nQl depend Qn the lype of electronic watermark data, 

tronic watermark data because of the absence of the original 25 When the electronic wa termark data burying process is 

image, performed plural times, the same electronic watermark data 

To overcome that problem, an improvement of the above- ^ again bufied Qn the frequency spe ctrum of an image with 

mentioned method for the terminal processing has been data previous i y buried. If the same electronic watermark 

proposed. In the improved method, the original image is datfl fe buded twice Qf mree timeSj the upper black portion 

divided into blocks each having K pixelsxK pixels. Elec- 3Q corresponding t0 the bur i e d amount becomes larger in the 

tronic watermark data is buried or extracted in block process frequency spec trum 440' after the burying process. When the 

units, frequency region of the spectrum is converted into the time 

In the electronic watermark data burying process, AC reg i orjj toe burying noises become larger, so that images are 

frequency components are set as f(l), f(2), . . . , f(n) in a emp hasizcd with the noise components, 

frequency increasing order over a frequency range after the 3S £ach piece of electromc watermark data is inserted as 

discrete cosine transformation. The electronic watermark vefy fceWe nQ[sc ^ compared ^ t he original image and is 

data, w(l), w(2), . . . , w(n) are selected from the normal nQt reC0 g n i Z ed by a human eye. However, there is 

distribution having an average of 0 and a dispersion of 1. In the problem in lnat if noises repeatedly integrated are large, 

order to obtain respective (i)s, the formula of F(i)=f(i)+ax it may ^ sensed by lhe human eye> thus lead i ng to de g ra - 
avg(f(i))xw(i) is calculated, where a is a scaling factor and 4Q datkm in image qua[ity 
avg(f(i)) is a partial average obtained by averaging the 

absolute values at three points adjacent to f(i). An image in SUMMARY OF THE INVENTION 

which electronic watermark data is buried can be obtained Th e present invention is made to solve the above- 

from the frequency components where f(i) is substituted mentioned problems. 

with F(i). 45 Moreover, the objective of the invention is to provide an 

Electronic watermark data is detected according to the electronic watermark data burying device that can bury the 

following method. This method does not require any original same electronic watermark data into an image only once, not 

image. It is merely required that electronic watermark data duplicatively. 

candidate w(i) (where i-1, 2, . . . , n) is known. jhc objective of the present invention is achieved by an 
Over the frequency band where electronic watermark data 5Q electromc watermark insertion device comprising discrete 

contained image is subjected to a discrete cosine cos ine transforming means for subjecting an input image to 

transformation, the frequency components are set as F(l), a discrete transformation; electronic watermark bury- 

F(2), . . . , F(n) in a frequency increasing order. The average ing means for msertmg electronic watermark data into data 

of the absolute values of three adjacent points in the water- transformed by the discrete cosine transforming means; 
mark data F(i) is set to a partial average avg(F(i)). The 55 e i ectromc watermark detecting means for detecting whether 

electronic watermark data W(i) is obtained by calculating or not the e i eclron f c watermark data to be inserted by the 

the following formula. electronic watermark burying means has been already 

w(i)-F(i)/avg{F(i)) inserted into the input image; and selecting means for 

Moreover, the sum WF(i) is obtained by calculating w(i) the W ^ ^ m lhe d ^^^^ 
for each frame according to the above-mentioned formula. « "fi mea f w * en he electronic watermark detecting means 

Next the statistical similarity C between w(i) and WF(i) is detects tat the electronic watermark da < 1 has toady 

obtained by calculating the following formula including an int <> l t he ^P^ 1 ^ ° r K for ^^^^iS 

•hi from lhe electromc watermark burying means when the 

vector inner product: electronic watermark detecting means does not detect that 
c-wf*w/(wfdxwD) . 65 tne electronic watermark data has been inserted into the 

where WF=(WF(1), WF(2), . . . , WF(n)); w=(w(l), input image; and means for subjecting data selected by the 

w(2), .... w(n)); WFD=thc absolute value of a vector WF; selecting means to an inverse discrete cosine transformation. 
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In the electronic watermark insertion device according to 
the present invention, the electronic watermark detecting 
means decides that the corresponding electronic watermark 
data is buried, when a statistical similarity C is more than a 
specific value. 

Moreover, in the electronic watermark insertion device 
according to the present invention, the electronic watermark 
detecting means first orthogonally converts an image with 
the electronic watermark data into a frequency component; 
calculates and extracts electronic watermark data W(i) using 
the formula W(i)-(F(i)-f(i))/f(i), where both an original 
image and electronic watermark data candidate wi (where 
i=l, 2, . . . n) are known; where f(l), f(2), . . . f(n) to which 
electronic watermarks are respectively buried in a frequency 
range correspond factor values F(l), F(2), . . . , F(n); next 
calculates a statistical similarity C between w(i) and W(i) 
using the formula, C=W«w/(WDxwD), where W-(W(1), 
W(2), . . . W(n)), w«(w(l), w(2), . . . w(n)), WTMhe 
absolute value of a vector W, and wD-the absolute value of 
a vector w), and the symbol * represents a vector inner 
product; and detects that the electronic watermark data is in 
a buried state when the statistical similarity C is more than 
a specific value. 

In the electronic watermark insertion device according to 
the present invention, the electronic watermark burying 
means sets AC frequency components (f(l), f(2), . . . , f(n)) 
in a frequency increasing order over a frequency range after 
a discrete cosine transformation; selects electronic water- 
mark data, w(l), w(2), , . . , w(n), from normal distribution 
having an average of 0 and a dispersion of 1; and calculates 
respective (i)s the formula, F(i)=f(i)+ax|f(i)|xw(i) (where a 
is a scaling factor) so that an image, in which the electronic 
watermark data is buried, is obtained from the frequency 
component in which f(i) is substituted with F(i). 

Moreover, in the electronic watermark insertion device 
according to the present invention, the electronic watermark 
burying means sets AC frequency components (f(l), 
f(2), . . . , f(n)) in a frequency increasing order over a 
frequency range after a discrete cosine transformation; 
selects electronic watermark data, w(l), w(2), . . . , w(n), 
from normal distribution having an average of 0 and a 
dispersion of 1; and calculates respective (i)s using the 
formula, F(i)»f(i)+axavg|f(i)|xw(i) (where a is a scaling 
factor and avg f(i) is a partial average of absolute values of 
f(i) at three adjacent points) so that an image, in which the 
electronic watermark data is buried, is obtained from the 
frequency component in which f(i) is substituted with F(i). 

Moreover, according to the present invention, an elec- 
tronic watermark insertion device comprises orthogonal 
converting means for subjecting an input image to an 
orthogonal conversion; electronic watermark burying means 
for inserting electronic watermark data to data converted by 
the orthogonal converting means; electronic watermark 
detecting means for detecting whether or not the electronic 
watermark data to be inserted by the electronic watermark 
burying means has been already inserted into the input 
image; selecting means for selecting the output data from the 
orthogonal converting means when the electronic watermark 
detecting means detects the electronic watermark data 
already inserted into the input image or for selecting output 
data from the electronic watermark burying means when the 
electronic watermark detecting means does not detect the 
electronic watermark data inserted into the input image; and 
means for subjecting data selected by the selecting means 
into an inverse discrete cosine transformation. 

Furthermore, according to the present invention, an elec- 
tronic watermark insertion device comprises orthogonal 
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converting means for subjecting an input image to an 
orthogonal conversion; electronic watermark detecting 
means for detecting whether or not electronic watermark 
data to be inserted has been already inserted into the input 

5 image; electronic watermark data selecting means for select- 
ing electronic watermark data by which the input image is 
not affected in data insertion when the electronic watermark 
detecting means detects the electronic watermark data 
already inserted into the input image or for selecting the 

to electronic watermark data to be inserted when the electronic 
watermark detecting means does not detect the electronic 
watermark data inserted into the input image; electronic 
watermark burying means for inserting electric watermark 
data selected by the electronic watermark data selecting 

15 means into data converted by the orthogonal converting 
means; and means for subjecting data into which the elec- 
tronic watermark data is buried by the electronic watermark 
burying means, to an inverse orthogonal conversion. 
In the electronic watermark insertion device according to 

20 the present invention, the electronic watermark detecting 
means decides that the corresponding electronic watermark 
data is buried, when a statistical similarity C is more than a 
specific value. 

In the electronic watermark inserting device according to 
25 the present invention, the orthogonal converting means 
performs discrete Fourier transformation, discrete cosine 
transformation, Hadamard-Walsh transformation, or 
Karhunen-Loeve transformation. 

30 BRIEF DESCRIPTION OF THE INVENTION 

This and other objects, features, and advantages of the 
present invention will become more apparent upon a reading 
of the following detailed description and drawings, in 
3 5 which: 

FIG. 1 is a block diagram illustrating an electronic water- 
mark data insertion device according to a first embodiment 
of the present invention; 

FIG. 2 is a block diagram illustrating an electronic water- 
4 0 mark data insertion device according to a second embodi- 
ment of the present invention; 

FIG. 3 is a block diagram illustrating a prior-art electronic 
watermark data insertion device; and 
45 FIG. 4 is a diagram explaining a method of burying 
electronic watermark data over a frequency band. 

DESCRIPTION OF THE EMBODIMENTS 

Embodiments of the present invention will be described 
50 below with reference to the attached drawings. 

First Embodiment 

The first embodiment of the present invention will be now 
described with reference with the drawings. Referring to 

55 FIG. 1, the electronic watermark data insertion device 
consists of an input image 110, a discrete cosine traasfor- 
mation (DCT) unit 120 for transforming an input image 
from a time region to a frequency region, an electronic 
watermark inserting unit 130 for inserting electronic water- 

60 mark data into data converted into a frequency region by 
means of the discrete cosine transformation unit 120, elec- 
tronic watermark data 140 to be inserted by the electronic 
watermark burying unit 130, an electronic watermark detec- 
tor 180 for detecting whether or not the electronic water- 

65 mark data 140 is inserted into data output from the discrete 
cosine transformation unit 120, a buffer 170 for temporarily 
storing data output from the discrete cosine transformation 
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unit 120, a selector 190 for selecting data from the electronic from the electronic watermark burying unit 230 from the 

watermark burying unit 130 or data from the buffer 170 in frequency region to the time region, and an output image 

response to the output from the electronic watermark detec- 260 to be output from the inverse discrete cosine transfor- 

tor 180, an inverse discrete cosine transformation (inverse mation unit 250. 

DCT) unit 150 for transforming data from the selector 190 5 Next, the operation of the electronic watermark data 

from a frequency region to a time region, and an output burying unit will be described with reference to FIG, 2. 

image 160 to be output from the inverse discrete cosine The discrele cosine traDs formation (DCT) unit 220 

transformation unit 150. orthogonally transforms the input image 210 from the lime 

Next, the operation of the electronic watermark data region to the frequency region. The transformed data is input 

burying device shown in FIG. 1 will be described with 10 to the electronic watermark burying unit 230 and the elec- 

reference to the drawings. Ironic watermark detector 280. 

The discrete cosine transformation (DCT) unit 120 The electronic watermark detector 280 detects whether or 

orthogonally converts the input image 110 from a time not there is the electronic watermark data B245 inserted into 

region to a frequency region. The converted data is input to the input data. The electronic watermark data selector 290 

the electronic watermark burying unit 130, the electronic 15 selects electronic watermark data based on the detection 

watermark detector 180 and the buffer 170. result of the electronic watermark detector 280. That is, 

The electronic watermark burying unit 130 inserts elec- WDCn the electronic watermark data detector 280 does not 
tronic watermark data 140 to the converted data. At the same detect electronic watermark data B245, the electronic water- 
time, the electronic watermark detector 180 detects whether mark data selector 290 selects it. When the electronic 
or not the electronic watermark data 140 is in an inserted watermark data detector 280 detects electronic watermark 
state in the input data. The buffer 170 temporarily stores the data » the electronic watermark data selector 290 selects the 
output data of the discrete cosine transformation unit 120. electronic watermark data A245. 

The selector 190 selects either the output data from the Because lhe in P ut ima S e converted into a frequency 

electronic watermark burying unit 130 or the output data 2S re 6»°n * delected, it is not needed to bury watermark 

from the buffer 170 based on the detection result of the information all over the space range of the input image, 

electronic watermark detector 180. That is, the selector 190 However, where a watermark image is buried in a part of 

selects the output data from the electronic watermark bury- divided blocks of the in P m ima S e > the missm 8 information 

ing unit 130 when the electronic watermark detector 180 aboul a block can bc restorcd with information about another 

does not detect the output data and selects the output data 30 b ^ oc * c - 

from the buffer 170 when the electronic watermark detector The electronic watermark burying unit 230 inserts elec- 

180 detects the output data tronic watermark data selected by the electronic watermark 

Hie data selected by the 'selector 190 corresponds to>he data f ect ° r 290 in, ° »" ima f ■ ^ ' ™ erse *J"»? °° s ™ 

output image 160 transformed from the frequency region to ««nsformat.on un.t 250 transform s the output data from the 

the time region by the inverse cosine transformation unit 35 electronic watermark burying un.t 230 from the frequency 

.. . ft <*■ ' region to the time region and then outputs the output image 

260. 

As described above, only when the ioputinuge 110 does e|eclronic watenMrk daU nm with no 

not contain the electronic watermark data 140, the electronic £ 8 compo „ e nts does not adversely affect the input 

watermark data 140 is inserted in the input imaee 110. . n A . t_- l • i *■ 

« iu^. v B image. Hence, the input image which previously contains 

In this embodiment, the buffer 170 is used to synchronize tne electronic watermark data B245 is not substantially 

two data to be selected by the selector 190 with each other, subjected to the electronic watermark data insertion and is 

in consideration of the process time of the electronic water- output without any change. 

mark burying unit 130. If the process lime of the electronic In this embodiment, it ^ assumc d that the process time of 

watermark burying unit 130 is practically and negligibly lhc electronic watermark detector 280 and the data selector 

short, the buffer 170 can be omitted. 29Q ^ neg iigibly short. If the process time is not negligible, 

a buffer is connected to the input of the electronic watermark 

Second Embodiment , . . „ n r „ , „. r , ... . . 

burying unit 230. llie buffer temporarily stores the output 

Next, the second embodiment of the present invention data of the discrete cosine transformation unit 220 and then 

will be described with reference to the attached drawings. 50 inputs it to the electronic watermark data detector 230. Thus 

Referring to FIG. 2, the electronic watermark data inser- th e process time of the electronic watermark detector 280 

tion device consists of an input image 210, a discrete cosine and the electronic watermark data selector 290 can be 

transformation (DCT) unit 220 for transforming an input canceled. 

image from a time region to a frequency region, electronic Where the block coordinates are known, the electronic 

watermark data B245 to be inserted, electronic watermark 55 watermark detection can be performed according to the 

detector 280 for detecting whether or not the electronic above-mentioned embodiment. It is not necessary that the 

watermark data 245 is inserted into data output from the spatial block coordinates are known. However, it is needed 

discrete cosine transformation unit 220, an electronic water- that the block size (k pixelsxk pixels), conversion rule to 

mark data selector 290 for selecting the electronic water- frequency regions, electronic watermark data, and the like 

mark data A240 or the electronic watermark data B245 60 are known. Such information are predetermined between the 

based on the detection result from the electronic watermark electronic watermark inserting device and the detector. If the 

detector 280, an electronic watermark burying unit 230 for information is leaked to the third party, data may be illegally 

inserting electronic watermark data selected by the elec- replicated. 

tronic watermark data selector 290 into data transformed In the above-mentioned embodiment, original images are 

into a frequency region by means of the discrete cosine 65 subjected to a discrete cosine transformation (DCT). The 

transformation unit 220, an inverse discrete cosine transfor- frequency spectrum may bc resolved by performing 

mation (inverse DCT) unit 250 for transforming data output orthogonal conversion including Hadamard transformation 
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(Hadamard- Walsh transformation), wavelet transformation, 
multiple resolution, sub-band method, discrete Fourier 
transformation, Haar transformation, Karhunen-Loeve 
transformation, gradient Hadamard transformation, and the 
like. 

Each above-mentioned embodiment shows the example 
of burying invisible electronic watermark data. However, 
the concept of the invention is not impaired by burying 
visible electronic watermark data. 

Moreover, in each embodiment, the scaling parameter can 
be selected from scaling parameters that add an additional 
watermark value that adversely affects the visual quality of 
data. The watermark value can be selected according to the 
normal distribution. 

As described above, the present invention has the advan- 
tage in that since the same electronic watermark data is not 
buried in an image plural number of times, degradation in 
image quality can be avoided. 



ironic watermark data candidate wi (where i«l, 2, . . . n) are 
known; where f(l), f(2), . . . f(n) to which electronic 
watermarks are respectively buried in a frequency range 
correspond factor values F(l), F(2), , . . F(n); next calculates 
5 a statistical similarity C between w(i) and W(i) using the 
formula, OW«w/(WDxwD), where W«(W(1), W(2), . . . 
W(n)), w=(w(l), w(2), . . . w(n)), WD=the absolute value of 
a vector W, and wD=the absolute value of a vector w, and the 
symbol • represents a vector inner product; and detects that 
10 said electronic watermark data is in a buried state when said 
statistical similarity C is more than a specific value. 

4. The electronic watermark insertion device defined in 
claim 1, wherein said electronic watermark burying means 
sets AC frequency components (f(l), f(2), . . . , f(n)) in a 
35 frequency increasing order over a frequency range after a 
discrete cosine transformation; selects electronic watermark 
data, w(l), w(2), . . . , w(n), from normal distribution having 
an average of 0 and a dispersion of 1; and calculates 



respective (i)s the formula, F(i)=f(i)+ax|f(i)|xw(i) (where a 

Moreover, the present invention can deal with electronic 2 o is a scaling factor) so that an image, in which said electronic 

watermark data visually or invisibly. Hence, the degradation watermark data is buried, is obtained from the frequency 

in image quality of the particular portion where the same component in which f(i) is substituted with F(i). 

electronic watermark data is overwritten can be avoided by 5. The electronic watermark insertion device defined in 

detecting the presence or absence of the same electronic c i a i m i j wherein said electronic watermark burying means 

watermark data within an image with reference electronic 2 s sets AC frequency components (f(l), f(2), . . . , f(n)) in a 

watermark data. Even the original image copyright holder frequency increasing order over a frequency range after a 

cannot insert electronic watermark data to the original image discrete cosine transformation; selects electronic watermark 

twice or more so that the author personality right can be data, w(l), w(2) w(n), from normal distribution having 

substantially maintained validly. an average of 0 and a dispersion of 1; and calculates 

The entire disclosure of Japanese Application No. 30 respective (i)s using the formula, F(i)«f(i)+axavg|f(i)|xw(i) 



35 



40 



45 



10-123691 filed May 6, 1998 including specification, 
claims, drawing and summary are incorporated herein by 
reference in its entirely. 
What is claimed is: 

1. An electronic watermark insertion device, comprising: 
discrete cosine transforming means for subjecting an 

input image to a discrete cosine transformation; 

electronic watermark burying means for inserting elec- 
tronic watermark data into data transformed by said 
discrete cosine transforming means; 

electronic watermark detecting means for detecting 
whether or not said electronic watermark data to be 
inserted by said electronic watermark burying means 
has been already inserted into said input image; and 

selecting means for selecting said output data from said 
discrete cosine transforming means when said elec- 
tronic watermark detecting means detects that said 
electronic watermark data has been already inserted 
into said input image or for selecting output data from 50 
said electronic watermark burying means when said 
electronic watermark detecting means does not detect 
that said electronic watermark data has been inserted 
into said input image; and 

means for subjecting data selected by said selecting 55 
means to an inverse discrete cosine transformation. 

2. The electronic watermark insertion device defined in 
claim 1, wherein said electronic watermark detecting means 
decides that the corresponding electronic watermark data is 
buried, when a statistical similarity C is more than a specific 60 
value. 

3. The electronic watermark insertion device defined in 
claim 1, said electronic watermark detecting means first 
orthogonally converts an image with said electronic water- 
mark data into a frequency component; calculates and 65 
extracts electronic watermark data W(i) using the formula 
W(i)=(F(i)-f(i))/f(i), where both an original image and clec- 



(where a is a scaling factor and avg f(i) is a partial average 
of absolute values of f(i) at three adjacent points) so that an 
image, in which said electronic watermark data is buried, is 
obtained from the frequency component in which f(i) is 
substituted with F(i). 

6. An electronic watermark insertion device comprising: 
discrete cosine transforming means for subjecting an 

input image to a discrete cosine transformation; 

electronic watermark detecting means for detecting 
whether or not electronic watermark data to be inserted 
has been already inserted into said input image; 

electronic watermark data selecting means for selecting 
electronic watermark data by which said input image is 
not affected in data insertion when said electronic 
watermark detecting means detects said electronic 
watermark data already inserted into said input image 
or for selecting said electronic watermark data to be 
inserted when said electronic watermark detecting 
means does not detect said electronic watermark data 
inserted into said input image; 

electronic watermark burying means for inserting electric 
watermark data selected by said electronic watermark 
data selecting means into data transformed by said 
discrete cosine transforming means; and 

inverse discrete cosine transforming means for subjecting 
data into which said electronic watermark data is buried 
by said electronic watermark burying means, to an 
inverse discrete cosine transformation. 

7. The electronic watermark insertion device defined in 
claim 6, wherein said electronic watermark detecting means 
decides that the corresponding electronic watermark data is 
buried, when a statistical similarity C is more than a specific 
value. 

8. The electronic watermark insertion device defined in 
claim 6, said electronic watermark detecting means first 
orthogonally converts an image with said electronic water- 
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mark data into a frequency component; calculates and 
extracts electronic watermark data W(i) using the formula 
W(i)*=(F(i)-f(i))/f(i), where both an original image and elec- 
tronic watermark data candidate wi (where i=l, 2, . . . n) are 
known; where f(i), f(2), . . . f(n) to which electronic 
watermarks are respectively buried in a frequency range 
correspond factor values F(l), F(2), . . . F(n); next calculates 
a statistical similarity C between w(i) and W(i) using the 
formula, CoW»w/(WDxwD), where W=(W(1), W(2), . . . 
W(n)), w=(w(l), w(2), . . . w(n)), WD-the absolute value of 
a vector W, and wD~the absolute value of a vector w, and the 
symbol • represents a vector inner product; and detects that 
said electronic watermark data is in a buried state when said 
statistical similarity C is more than a specific value. 

9. The electronic watermark insertion device defined in 
claim 6, wherein said electronic watermark burying means 
sets AC frequency components (f(l), f(2), . . . , f(n)) in a 
frequency increasing order over a frequency range after a 
discrete cosine transformation; selects electronic watermark 
data, w(l), w(2), . . . , w(n), from normal distribution having 
an average of 0 and a dispersion of 1; and calculates 
respective (i)s the formula, F(i)=f(i)+ax|f(i)|xw(i) (where a 
is a scaling factor) so that an image, in which said electronic 
watermark data is buried, is obtained from the frequency 
component in which f(i) is substituted with F(i). 

10. The electronic watermark insertion device defined in 
claim 6, wherein said electronic watermark burying means 
sets AC frequency components (f(l), f(2), . . , , f(n)) in a 
frequency increasing order over a frequency range after a 
discrete cosine transformation; selects electronic watermark 
data, w(l), w(2), . . . , w(n), from normal distribution having 
an average of 0 and a dispersion of 1; and calculates 
respective (i)s using the formula, F(i)-f(i)+axavg|f(i)|xw(i) 
(where a is a scaling factor and avg f(i) is a partial average 
of absolute values of f(i) at three adjacent points) so that an 
image, in which said electronic watermark data is buried, is 
obtained from the frequency component in which f(i) is 
substituted with F(i). 

1.1. An electronic watermark insertion device, comprising: 

orthogonal converting means for subjecting an input 
image to an orthogonal conversion; 

electronic watermark burying means for inserting elec- 
tronic watermark data to data transformed by said 
orthogonal converting means; 

electronic watermark detecting means for detecting 
whether or not said electronic watermark data to be 
inserted by said electronic watermark burying means 
. has been already inserted into said input image; 

selecting means for selecting said output data from said 
orthogonal converting means when said electronic 
watermark detecting means detects said electronic 
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watermark data already inserted into said input image 
or for selecting output data from said electronic water- 
mark burying means when said electronic watermark 
detecting means does not detect said electronic water- 
5 mark data inserted into said input image; and 

means for subjecting data selected by said selecting 
means into an inverse discrete cosine transformation. 

12. The electronic watermark insertion device defined in 
claim 11, wherein said electronic watermark detecting 

10 means decides that the corresponding electronic watermark 
data is buried, when a statistical similarity C is more than a 
specific value. 

13. The electronic watermark inserting device defined in 
claim 11, wherein said orthogonal converting means per- 
is forms discrete Fourier transformation, discrete cosine 

transformation, Hadamard-Walsh transformation, or 
Karhunen-Loeve transformation. 

14. An electronic watermark iasertion device comprising: 
orthogonal converting means for subjecting an input 

20 image to an orthogonal conversion; 

electronic watermark detecting means for detecting 
whether or not electronic watermark data to be inserted 
has been already inserted into said input image; 

25 electronic watermark data selecting means for selecting 
electronic watermark data by which said input image is 
not affected in data insertion when said electronic 
watermark detecting means detects said electronic 
watermark data already inserted into said input image 

30 or for selecting said electronic watermark data to be 
inserted when said electronic watermark detecting 
means does not detect said electronic watermark data 
inserted into said input image; 
electronic watermark burying means for inserting electric 

35 watermark data selected by said electronic watermark 
data selecting means into data converted by said 
orthogonal converting means; and 
means for subjecting data into which said electronic 
watermark data is buried by said electronic watermark 

40 burying means, to an inverse orthogonal conversion. 

15. The electronic watermark insertion device defined in 
claim 14, wherein said electronic watermark detecting 
means decides that the corresponding electronic watermark 
data is buried, when a statistical similarity C is more than a 

45 specific value. 

16. The electronic watermark inserting device defined in 
claim 14, wherein said orthogonal converting means per- 
forms discrete Fourier transformation, discrete cosine 
transformation, Hadamard-Walsh transformation, or 

50 Karhunen-Loeve transformation. 

***** 
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